Random sampling in chirp space 
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Abstract 

For the space of functions that can be approximated by hnear 
chirps, we prove a reconstruction theorem by random samphng at 
arbitrary rates. 
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1 Introduction. Chirps, fractional Fourier trans- 
form and random sampling 

In the Frechet space of infinitely differentiable functions, with a topology 
defined by a family of norms 

\\fmn,k = ^^p\tV'^'Ht)\ n,k = 0,l,2,--- (1) 
the Fourier operator jFi 



oo 



(J-J) (uj) =F{u) = — ^ / e--V (t) dt (2) 

(zTT) J-oo 
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is an invertible transform with 

r-CX) 

A/2 



f (t) = TT^ / e^"*^ (^) (3) 



i2ny 



oo 



In the time-frequency plane with orthogonal axis t and u, the Fourier 
transform has a geometrical interpretation as a rotation of the signal by 
ai = |. The fractional Fourier transform [I] [2] [3] corresponds also to a 
rotation in t — u plane, but now by a non- integer multiple of |, = 6|, 
namely 



^ — 7j Sgnisina;,)^— a;, /-oo / ■ / ^ ^\\ 

(T,f) (C) = F.(C) = ^f^ -^7^ / e{-=^-i"-('"«'))/(i) A 

(27r |sinab|) J ~oo 



Sgn(sinai,)f-a6) /-oo 

(4) 

with inverse J^-h- 

Another way to look at the Fourier transform equation ([2]) IS clS cl decom- 
position of / into a combination of harmonics (the basis functions {e"*"^*}). 
As a result, the Fourier transform is a convenient way to code the signal 
when this one is a superposition of a (small) number of harmonics. 

Instead of e~*'^* the kernel of the fractional Fourier transform (jlj) is a 
linear chirp e"*^'^"'^*)* with uj = and c = |cotafe. This suggests that a 
more general basis to expand a signal, with arbitrary features in the uo — t 
plane, is a basis of linear chirps. 

The choice of the appropriate basis is an important issue when recon- 
structing signals from limited data and in particular for the reconstruction 
from non-uniform sampling. Sampling at irregular intervals is sometimes 
imposed by the nature of the phenomenon being observed as in the case 
of geological measurement, anemometry or radar signals. Reconstruction of 
the signal from such measurements poses special problems, because the usual 
spectral estimation methods are designed to work with equidistantly spaced 
time series. Special methods have therefore been developed to deal with the 
problem of irregular sampling of band-limited functions [1] [5] [6] [7j [8] [9]. 

Another problem, in the reconstruction or interpolation of signals, in the 
band-limited space, occurs when the sampling rate is below the Nyquist rate, 
especially in view of the Beurling-Landau density theorem [1] [10]. In this case 
irregular sampling of an appropriate type, instead of being a nuisance, may 
be of help for the asymptotically exact reconstruction of signals. This occurs 
in the space A of almost periodic functions and the basic mathematical result 
is the following: 



2 



Theorem 1 ( Collet lTT^ ) Let x„ = riA + X^ vjith X„ being a sequence of i.i.d. 
random variables uniformly distributed in [0,X]. Then, almost every config- 
uration {xn} of the point process has the property that if f is any complex 
almost periodic function satisfying 

f (xn) =0 \fneZ (5) 

Then / = 0. 



Recall that / is almost periodic [12] [13] if it is uniformly continuous and 
if Ve > 3A (e) such that any interval 

[a,a + A {e)] (6) 

contains a number t {a,e) such that 

snp\f{x + T{a,e))-f{x)\<e (7) 

X 

Given / (x) almost periodic, Ve > 3 a trigonometric polynomial g ap- 
proximating / uniformly, that is 3Bi (e) , ...,Ba {e) such that 

a 
k=l 

snp\f (x) ~ g{x)\ <e (9) 

The approximation by trigonometric polynomials and Collet's theorem 
provides a basis for asymptotically exact reconstruction algorithms at rates 
much below Nyquist's rate. However if the local signal frequencies vary in 
time the approximation by trigonometric polynomials is not very convenient. 
A more general chirp basis would be more appropriate. Here one provides 
a generalization of Collet's theorem to a space of functions that may be 
approximated by linear chirps. It contains, as a particular case, the space of 
almost periodic functions. 
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2 A uniform approximation result for ran- 
dom sampling in chirp space 

Instead of ([7j), the approximation by trigonometric polynomials (Eqs. [8] and 
[H]) provides an alternative, and equivalent, characterization of almost periodic 
functions. Likewise we define the space CC of linear chirp functions as the 
space of functions / such that > 3 a finite number of real number sets 

(cui, ci, ai, Bi) , (cufc, Cfc, Ofc, Bk) such that 



3=1 



^i{u!j+Cj {x—aj)}x 



and 



sup|/(a;) ~gix) \ <e 



(10) 



(the space of almost periodic functions corresponds to the Cj = case). 

The space CC of linear chirp functions is strictly larger than the space of 
almost periodic functions. It suffices to consider e*^ . If it were an almost 
periodic functions, it would exist ^ such that 



< e 



OO < X < CXD 



with e < 1. Choose x* = ^'^^^ and k odd. Then 



2> e 



a contradiction. 

For functions in CC one obtains the following: 



Theorem 2 Let Xn = nX + X„ with X„ being a sequence of i.i.d. random 
variables uniformly distributed in [0,X]. Then, almost every configuration 
{xn} of the point process has the property that if f is a function in the linear 
chirp space satisfying 

f [xn) = Vn G Z, 

then / = 0. 
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For the proof one needs the following 



Theorem 3 For almost every configuration of the random process, 

one has 

liin — — V e<"""+'="") = 
L^oo 2L + 1 ^ 

-L<n<L 

for real uj and c with uj ^ {]. 

The proof may follow similar steps as the proof of proposition 5 in [TT] . 
A simpler argument uses the invariant measure properties of the random 
dynamical system in the circle 

yn = ^{n\ + Xn) + ^{n\ + Xr,f (modi) (12) 

Let first c = 0,^7 7^ and (without loss of generality) A = 1. What the 
dynamical system (JT2l) does is to cover the circle with intervals of length 
^ and, in each one, to choose a point at random. Because X„ has uniform 
distribution in each interval, the distribution of ?/„ is also uniform. Therefore, 
by the ergodic theorem 

E e- = (e-->,.=0 (13) 

-L<n<L 

for generic sequences 

For c and 7^ 0, the proof is more delicate. At each step n, of the random 
dynamical system [T2|, the interval where the random point is chosen is 

—n + —n\ (n + 1) + — (n + 1)' (14) 

ZTT /TT /TT /TT J 

For all 

* 27r - 1 

n > n = 

2c 2 

the interval in (HM wraps one or more times over the circle. In the interval 
f[T^ the distribution of the random points would be 

a/cu^ + oircy 
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When the interval wraps around the circle the maximum possible deviation 
from uniformity of the density is 

Apn = -^==2^==== (15) 

Therefore we have a sequence {yn} of independent random variables with 
values in [0, 1] and each one has a density pjyy) with 

Pn{y) = 1 + r„(y) 

where 

sup \rn{x) \ = On . 

a;e[0,l] 

We are interested in the case in which 

an = (16) 

and what to check whether 



1 ^ 

and also to relate the speed of convergence in the second limit to the speed 
of convergence in the first limit. 
For each n, define y„ by 

y„ = sin(27rX„) (18) 
and let be its mean. Define Sj^ by 

N 
n=l 

Also, define M„(^) by 

M„(0 = E {f-) . (20) 

By Jensen's inequality, 

M„(0 > e"-^- . 
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The following lemma is a simple variant of a well known estimate of 
Cramer. The variation, probably not new, is that our sequence of random 
variables, {Yn}, is not identically distributed. 

Lemma 1 Suppose that for each N there is a convex function ^n{C) such 
that 

N 

J]lnM„(e/7V)<$;v(0 ■ (21) 

n=l 

Let iNiy) denote the Legendre transform of^^; i.e., 

7Ar(y)-sup(t/e-M0) ■ (22) 

Also, let 

1 ^ 

T^N ^ J^^lJ^n ■ (23) 

n=l 

Then, for any number y > m^, 

ln{Pr{Sr,/N>y))<-lN{y) . (24) 

Proof: By the Chebychev inequahty, for all ^ > 0, 

Pr {Sn/N >y)< e-y^E (e«^^/^) . 
But by the independence, 

N 
n=l 

and so 

TV 

ln{PT{SM/N>y)) < -ey + ^lnM„(e/7V) (25) 

n=l 

Since lnM„(,^) > for each n and ^, it follows rripj^ < ^n{0- Then 
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for each ^ < and y > 111^. Then 



Therefore, (12^ follows from (!25|) . 

The same sort of reasoning shows that for any number y < mjy, 

ln(Pr(5jv/iV<y)) < -lN{y) 

We now apply this in the following setting. From flTBl) we may deduce 
estimates on each lnM„(^) of the form 

lnM„(0</i„^ + Ce^ 

Then, 

N 
n=l 

In this case, we can apply the Lemma with 
Computing the Legendre transform, we then have 
Now, define ^at by 

,2 8ClnA^ 
'- = ^- 

Then 

Pr (^,v/A^ >mN + Bn) < e"^'''^/^^ = iV'^ . 

Since this is summable, the Borel-Cantelli lemma implies that the probability 
for Sn/N to exceed niN + infinitely often is zero. This large deviation 
estimate implies flTTl) . A similar reasoning applies for the cosine series. This 
completes the proof of theorem 3. 

Proof of theorem 2: 
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Let / (xn) = 0, Vn G Z and g (x) be its e— approximation by linear chirp 
polynomials. Then 



for all u and c. Inserting now Eq. (|TO|) in the left-hand side of the above 
equation one obtains 



Choosing on = ujj — cjaj , c = Cj and using the lemma, one concludes that 
for almost every configuration 



for all j in the linear chirp approximation. 

Because this result holds for all e and the linear chirp basis functions are 
kernels to the fractional Fourier transform, one concludes that the function 
/ has zero fractional Fourier spectrum. Therefore it is the zero function. □ 

As in the case of functions in the almost periodic space, the above result 
may be used to estimate functions in the linear chirp space by random sam- 
pling. If from a time series h one obtains, by the appropriate algorithm, 
a linear chirp approximation g (x) coinciding with the sampled function on 
a typical sequence {xn}, that is 

/ = g (xn) - h (Xn) = 

then, in the above defined space, one knows that g (x) = h (x) for all x. 

3 Nonlinear chirps 

By a nonlinear chirp, we mean a linear combination of functions of the form 
g«p(2^) where p is a real polynomial of some degree m > 2. As before, let 





BA < e 
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c denote the leading coefficient. The analysis leading to Theorem 3 easily 
extends to include nonlinear as well as linear chirps. Although these nonlinear 
chirp functions have no connection with the fractional Fourier transform 
when, it is of interest to see how far one may extend the analysis, especially 
as the extension requires very little modification. 

To see how this goes, observe that for large the leading term in p[x) 
dominates, and so there is an < oo so that for all |x| > A^, 

\p'{x)\ > {\c\m/2)\xr~'^ > 27r . (26) 

In particular, for \n\ > N, p{x) is monotone on [n, n + 1]. 

Let (Tniy) be the denisty for the random variable y = p{x) with x chosen 
uniformly in [n, n + 1] for \n\ > N. We may assume without loss of generality 
that p{x) is increasing on this interval, and in this case, 

(^niv) = \ , 

p'{x{y)) 

where p{n) < y < p{n + 1), and x{y) is the unique solution of p{x) = y. 

As before, the interval [p{n),p{n + 1)] "wraps" one or more times around 
the circle, inducing the density Pn{y) on the circle. The variation between 
the maximum and the minimum of p„ is no more than the maximum value 
of cr„(y). By our assumption fl26|) . this is no more than 2m|c|/n™~^. 

Therefore, we have that 

Pn{y) = 1 + rn{y) 

with 

sup |r„(x)| = a„ = . 

This is an improvement over (fT6!l . and from here, the proof of the analog of 
Theorem 3 proceeds as before. 
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